Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-430

Task stuck in cleanup with OutOfMemoryErrors

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.20.1
    • None
    • None
    • Reviewed
    • Hide
      Various code paths in the framework caught Throwable and tried to do inline cleanup. In case of OOM errors, such inline-cleanups can result into hung jvms. With this fix, the TaskTracker provides a api to report fatal errors (any throwable other than FSErrror and Exceptions). On catching a Throwable, Mapper/Reducer tries to inform the TT.
      Show
      Various code paths in the framework caught Throwable and tried to do inline cleanup. In case of OOM errors, such inline-cleanups can result into hung jvms. With this fix, the TaskTracker provides a api to report fatal errors (any throwable other than FSErrror and Exceptions). On catching a Throwable, Mapper/Reducer tries to inform the TT.

    Description

      Obesrved a task with OutOfMemory error, stuck in cleanup.

      Attachments

        1. MAPRED-430-v1.13-example.patch
          3 kB
          Amar Kamat
        2. MAPREDUCE-430.FI.patch
          0.6 kB
          Konstantin I Boudnik
        3. MAPREDUCE-430-v1.11.patch
          18 kB
          Amar Kamat
        4. MAPREDUCE-430-v1.12.patch
          18 kB
          Amar Kamat
        5. MAPREDUCE-430-v1.12-branch-0.20.patch
          18 kB
          Amar Kamat
        6. MAPREDUCE-430-v1.13.patch
          18 kB
          Amar Kamat
        7. MAPREDUCE-430-v1.13-branch-0.20.patch
          18 kB
          Amar Kamat
        8. MAPREDUCE-430-v1.6.patch
          12 kB
          Amar Kamat
        9. MAPREDUCE-430-v1.6-branch-0.20.patch
          12 kB
          Amar Kamat
        10. MAPREDUCE-430-v1.7.patch
          6 kB
          Amar Kamat
        11. MAPREDUCE-430-v1.8.patch
          8 kB
          Amar Kamat

        Activity

          People

            amar_kamat Amar Kamat
            amareshwari Amareshwari Sriramadasu
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: